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Abstract 

This  paper  considers  distributed  decision  systems  examplified  by  subdivisions  competing  for 
corporate  resources.  Corporate  coordinators  oversee  the  otherwise  independent  activities  of  the 
subdivisions  by  setting  prices  (or  premiums)  on  the  resources.  Taking  such  prices  into  account, 
subdi visional  planners  submit  proposals  which  will  be  weighed  by  the  coordinators  who  then  may 
adjust  the  prices.  If  equilibrium  prices  can  be  established,  an  optimal  allocation  of  the  resources  will 
be  made  by  the  coordinators.  The  behavior  of  this  decision  process  is  greatly  affected  by  the 
manner  in  which  information  is  communicated  among  the  parries  involved.  We  discuss  four  classes 
of  information  schemes  and  study  the  dynamics  of  information  involved.  It  is  shown  that  the 
overall  effectiveness  of  any  scheme  depends  on  behavioral  patterns  of  the  interacting  agents  and 
that  no  single  scheme  can  be  universally  superior.  However,  it  may  be  possible  to  identify 
favorable  schemes  for  specific  decision  systems  by  observing  patterns  in  the  behavior  of  the 
coordinators  and  the  planners." 

Keywords:  Distributed  Decision  Systems;  Information  Management;  Parallel  Processing;  , 
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1.  Introduction 

Practically  all  systems  and  organizations  are  structured  with  interacting  components. 
Regardless  of  whether  there  is  a  clear-cut  hierarachy  of  commands  or  not,  important  global 
decisions  invariably  involve  the  judgment  made  locally  at  the  component  level.  We  call  such  an 
environment  a  distributed  decision  system.  Central  to  its  successful  operation  is  the  process  of 
coordination  which  always  relies  on  the  communication  of  information  among  the  components, 
regardless  of  the  underlying  decision  making  policy.  When  such  coordinating  information  becomes 
available  and  when  it  is  actually  used  will  be  important  factors  in  the  effectiveness  of  the  system. 
We  call  the  study  of  these  factors  the  dynamics  of  information  in  distributed  decision  systems. 

To  study  and  analyze  the  dynamics  of  information  in  the  broadest  sense  of  distributed 
decision  systems  will  be  difficult,  if  not  impossible.  As  a  first  step,  we  narrow  our  attention  to  a 
specific  and  somewhat  more  tractable  situation  which  can  be  modeled  as  the  price-directive 
decomposition  of  a  block-angular  linear  program  (see  e.g.  Dantzig  1963,  Jennergren  and  Muller 
1973,  Maier  and  Vander  Weide  1976,  Christensen  and  Obel  1978,  Dirickx  and  Jennergren  1979, 
Nazareth  1980,  Samouilidis  and  Arabatzi-Ladia  1984).  Consider  a  corporate  structure  with 
subdivisions  competing  for  common  resources.  Corporate  coordinators  oversee  the  otherwise 
independent  activities  of  the  subdivisions  by  setting  prices  (or  premiums)  on  the  resources.  Taking 
such  prices  into  account,  subdivisional  planners  submit  proposals  which  will  be  weighed  by  the 
coordinators  who  in  turn  may  adjust  the  prices.  If  equilibrium  prices  can  be  established,  an  optimal 
allocation  of  the  resources  will  be  made  by  the  coordinators.  Assuming  further  that  both  the 
objective,  corporate  resource  and  subdivisional  operations  can  be  modeled  by  linear  constraints,  the 
above  decision  process  is  exactly  the  Dantzig-Wolfe  decomposition  algorithm  for  the  underlying 
linear  programming  model.  Note  that  we  are  not  proposing  LP  decomposition  as  a  decision 
process.  Rather,  we  assume  that  certain  real  life  decision  processes  can  be  approximated  in  such  a 
way  and  proceed  to  analyze  their  dynamics  of  information.  This  is  made  possible  by  studying 
various  information  schemes  that  correspond  to  different  solution  strategies  in  the  decomposition 
algorithm. 

After  a  brief  review  of  Dantzig-Wolfe  decomposition  of  block-angular  linear  programs,  four 
information  schemes  which  determine  the  precise  flow  of  proposals  and  prices  (i.e.  dynamics  of 
information)  in  the  process  of  coordination  are  described.  A  numerical  example  is  then  used  to 
illustrate  the  efficacy  of  these  schemes.  It  is  shown  that  the  relative  effectiveness  of  the  information 
schemes  under  study  depends  on  inherent  properties  of  the  system,  e.g.  the  relative  complexities  of 
the  coordinating  and  subdivisional  problems.  For  this  reason,  it  would  not  be  appropriate  to  search 
for  a  universal  scheme  that  is  superior  for  all  decision  systems.  However,  we  may  be  able  to 
identify  the  most  effective  scheme  for  a  given  system  by  a  priori  analysis.  In  this  sense,  we  can 
classify  distributed  decision  systems  by  their  dynamics  of  information. 
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2.  Dantzig-W’olfe  Decomposition  of  Block-Angular  Linear  Programs 


2.1  Summary  of  the  Algorithm 

As  a  first  step  in  analyzing  the  dynamics  of  information  in  distributed  decision  systems,  we 
consider  decision  processes  that  can  be  modeled  as  Dantzig- Wolfe  decomposition  (Dantzig  and 
Wolfe  1960)  of  a  block-angular  linear  program  (BLP).  Such  a  problem  with  R  blocks  has  the 
following  form  in  which  vectors  and  matrices  are  denoted  in  bold-face,  and  a  prime  denotes  a 
transpose. 


minimize  1^..*  (1) 

(P)  subject  to  Ir_o  r  A^  =  b0  (2) 

BrXr  =  br;  r  =  1 . R  (3) 

xr  ^  0;  r  =  0 . R  (4) 


where  Cj.  is  1  x  rip  br  is  m,.  x  1  and  all  other  vectors  and  matrices  are  of  compatible  dimensions. 

First,  we  summarize  the  Dantzig-Wolfe  decomposition  algorithm  (see  Ho  1987  for  recent 
development  in  this  approach).  Then  its  interpretation  as  a  distributed  decision  process  will  be 
given.  Let  Fr  =  {xr  I  B^  =  br  xr  £  0}  be  the  set  of  all  feasible  solutions  to  subproblem  r,  and 

Xr  =  {xrk  ;  k=l,...,Kr  I  xr^  is  an  extreme  point  of  Fr)be  the  set  of  extreme  points  of  Fr  For 

simplicity,  we  assume  that  Fr  is  nonempty  and  bounded.  It  is  then  a  bounded  polyhedral  convex 

set.  Using  the  fact  that  any  point  in  such  a  set  can  be  represented  by  a  nonnegative  convex 
combination  of  its  extreme  points,  one  can  rewrite  (P)  in  the  following  equivalent  extremal  form 
[Dantzig  1963]: 


Min  £r=l,...,R  2i«lf..,Kr  feiVJNri 
s  t  £  r=i,...,R  Ii=l,..,Kr  (Vr1)  *ri  *  d 
(E)  ^i=l,.„,Kr  ^ri  =  1  •  r=l.---.R 

^  0,  i=l,...,Kr;  r=l,...,R,  where  xr*e  Xp 


Thus  solving  (E)  is  equivalent  to  solving  (P).  Since  K  is  often  vety  large  and  not  known  a 
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priori ,  a  relaxation  strategy  is  applied  to  solve  (E).  The  Dantzig- Wolfe  decomposition  algorithm 
uses  a  subset  of  Jr  extreme  points  in  Xj  to  formulate  a  Restricted  Master  Problem,  say. 


Min  zk  =  Xr=i,...*Xi=Wr(crV)Ari 
s.t  X  r=l,...,R  ^i=l,..,Jr  (Arxr*)  ^ri  =  d 

(Mk)  ^i=l,... Jr  ^ri  =  r=1’”-»R 

Xyj  2  0,  i*l,...Jr  ;  r=l,...,R. 

During  the  k-th  cycle  of  the  algorithm,  (Mk)  is  solved.  Let  (7tk,  Ojk  o^k )  be  the 

optimal  dual  solution.  The  vector  7tk  is  known  as  the  price  vector  corresponding  to  the  coupling 
constraints.  To  see  if  the  objective  can  be  further  improved  by  introducing  any  extreme  point  in  X 
not  yet  included  in  Mk,  the  following  subproblem  is  solved.  This  is  essentially  an  implicit  simplex 
pricing  step  using  the  prices  7tk. 

min  vrk  =  (Cj.-  nk  Ar)xr  -afk 

s.t.  Brxr  =  br 
xr  £  0 . 

If  vrk  2:  0  ,  then  nothing  in  Fr  can  improve  the  objective.  If  this  holds  for  all  r,  then  the 
solution  of  (Mk)  is  optimal  for  (E).  Otherwise  a  new  extreme  point,  cabled  a  proposal,  with  vrk  < 
0  can  be  included  in  (Mk+*)  for  an  improved  solution  in  the  next  cycle.  Convergence  is  finite  as 

each  Xj.  is  a  finite  set  (see  [Dantzig  1963]).  Furthermore,  if  pk  is  the  dual  optimal  solution  to  (Sj.k), 

then  (7ik,  Pjk,...,  p£k )  is  a  dual  feasible  solution  to  (P)  and  hence  provides  a  lower  bound  on 
the  minimum  value  of  z.  Therefore,  in  practice,  we  can  stop  the  decomposition  algorithm  if  I  z^- 
<  e  for  some  e  2  0. 
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2.2  A  Distributed  Planning  Scenario 

The  above  algorithm  can  be  interpreted  as  a  distributed  decision  system.  Note  that  our 
purpose  is  not  so  much  proposing  such  a  process  for  decision  making  as  assuming  that  it  is  the 
appropriate  model,  perhaps  as  a  first  approximation,  for  certain  planning  scenarios.  Consider  a 
planning  process  where  there  are  R  planners  representing  as  many  divisions  of  a  company.  Each 
planner  has  at  his  disposal  a  certain  amount  of  local  resources  and  shares  some  company  wide 
resources  with  other  planners.  As  the  planning  process  proceeds,  each  planner  is  required  to  submit 
local  plans  (proposals)  by  solving  a  local  subsystem  (an  LP).  Each  proposa.1  submitted  must 
improve  the  current  objective  value  of  the  entire  planning  problem.  Therefore,  a  proposal  represents 
a  local  decision  that  specifies  the  amount  of  shared  resources  required  for  its  implemention. 

A  coordinator  is  put  in  charge  of  the  process  so  that  an  optimal  plan  for  the  entire  problem 
can  be  obtained.  He  does  this  by  controlling  the  allocation  of  shared  resources.  Each  of  the  shared 
resources  is  given  a  price,  which  represents  its  worth.  The  planner  will  be  charged  for  using  the 
shared  resources.  Based  on  proposals  submitted  by  the  planners,  the  coordinator  will  determine  a 
set  of  prices  for  the  shared  resources  by  solving  a  Master  Problem,  which  is  an  LP  formulated 
using  all  the  proposals  on  hand.  The  new  prices  will  then  be  sent  to  the  planners.  The  planners 
discard  the  old  prices  and  work  on  new  plans  according  to  the  new  prices.  This  iterative  process 
continues  until  the  coordinator  arrives  at  a  set  of  prices  at  which  no  new  proposal  is  generated  by 
the  planners.  At  this  point,  the  planning  process  is  said  to  have  converged  to  optimality.  The 
information  flow  in  this  planning  scenario  is  shown  in  Figure  1. 

The  rate  at  which  the  planning  process  converges  to  optimality  is  of  basic  interest.  Clearly, 
the  proposals  and  prices  information  is  crucial  to  the  dynamics  of  the  above  planning  process. 
Since  the  coordinator  is  working  concurrently  with  the  planners,  the  set  of  prices  for  the  shared 
resources  will  be  constantly  changing  as  new  proposals  are  being  incorporated  by  the  coordinator. 
For  die  coordinator,  the  questions  are:  when  should  the  new  prices  be  sent  to  the  planners  ?  Which 
prices  should  be  sent  ?  When  should  the  planners  be  told  to  stop  submitting  proposals  according  to 
certain  prices?  The  generation  of  proposals  by  each  planner  is  very  much  influenced  by  when  and 
what  prices  are  received  from  the  coordinator.  In  turn,  the  timing  and  nature  of  the  proposals  affect 
directly  the  prices  generated  by  the  coordinator.  For  the  planners,  the  questions  are:  when,  and 
which  proposals  should  be  submitted?  When  should  a  new  set  of  prices  be  used  in  generating 
proposals?  Previous  studies  of  price-directive  decomposition  (see  e.g.  Burton  and  Obel  1977  and 
1980,  Moore  1979)  as  well  as  the  dual  approach  of  resource-directive  decomposition  (see  e.g. 
Silverman  1972,  Ten  Kate  1972,  Freeland  and  Moore  1977,  Burton  and  Obel  1980)  emphasized 
primarily  on  the  organizational  structure  and  the  hierachy  of  information  flow  among  the  agents. 
The  present  work  focuses  on  the  concurrent  nature  of  the  activities  of  the  agents  as  well  as  the 
timing  and  communication  of  information  among  them.  The  algorithmic  implications  are  found  to 
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be  significant  in  the  advent  of  parallel  computation  using  multiple-processor  computers  (see  Ho  et 
al  1988). 


n*  (optimal  prices) 


Figure  1.  Information  Flow  in  Dantzig- Wolfe  Decomposition 
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3.  Dynamics  of  Information  in  Distributed  Dantzig-Wolfe  Decomposition 


The  timing  and  nature  of  information  made  available  and  utilized  in  the  above  planning 
process  is  the  subject  of  our  study.  Several  schemes  that  control  the  flow  of  information  will  be 
described  in  the  following  sections.  The  dynamics  of  information  and  its  effect  on  the  decision 
process  will  be  discussed.  It  should  be  remarked  that  while  the  interpretation  of  LP  decomposition 
as  a  distributed  decision  process  (or  what  is  traditionally  termed  decentralization)  is  well  known, 
our  approach,  which  takes  into  account  of  concurrency,  did  not  become  obvious  until  the  recent 
advent  of  parallel  computation.  To  make  the  distinction  algorithmically,  we  shall  refer  to 
implementations  of  LP  decomposition  which  take  advantage  of  parallel  computation  as  distributed 
Dantzig-Wolfe  decomposition. 

An  information  scheme  in  distributed  Dantzig-Wolfe  decomposition  controls  the  flow  of 
proposal  and  prices  information.  We  consider  four  information  schemes,  namely,  the  Basic 
Information  Scheme  (BIS),  the  Early  Start  Information  Scheme  (ESIS),  the  Early  Termination 
Information  Scheme  (ET1S),  and  the  Intermediate  Prices  Information  Scheme  (IPIS).  They  are 
compared  in  terms  of  synchronization,  information  flow  and  concurrency. 

3.1  Basic  Information  Scheme  (BIS) 

In  a  decision  system  corresponding  to  the  sequential  Dantzig-Wolfe  decomposition  algorithm 
(SDWDA),  the  R  planners  and  the  coordinator  can  be  considered  to  be  sharing  a  single  information 
processing  facility.  They  take  turn  using  the  facility.  Once  a  new  set  of  prices  is  announced  by  the 
coordinator,  each  planner  queues  up  to  solve  his  subsystem  and  stores  the  proposals  in  a  common 
buffer  used  by  all  the  planners.  When  all  the  planners  have  completed  their  proposals  generation, 
the  coordinator  will  collect  all  the  proposals  from  the  buffer  to  determine  the  next  set  of  prices. 

In  a  scenario  corresponding  to  the  distributed  Dantzig-Wolfe  decomposition  algorithm 
(DDWDA),  the  coordinator  and  planners  each  has  his  own  information  processing  facility  and  can 
process  the  information  in  parallel.  For  the  purpose  of  comparison,  we  consider  a  scheme  for 
DDWDA  where  the  flow  of  information  is  fully  synchronized  and  identical  to  SDWDA.  We  call 
this  the  Basic  Information  Scheme  (BIS).  BIS  differs  from  SDWDA  in  that  the  planners  will 
generate  proposals  concurrently,  while  the  coordinator  will  be  idle  and  waiting  for  all  the  proposals 
to  come  in.  The  process  of  determining  new  prices  willl  begin  after  all  the  planners  have  submitted 
their  proposals.  During  the  time  when  the  coordinater  is  processing  the  proposals  to  get  a  new  set 
of  prices,  all  the  planners  will  be  idle  and  waiting  for  the  new  prices  to  start  another  round  of 
proposals  generation. 

An  illustraton  of  this  information  scheme  with  three  planners  is  shown  in  Figure  2.  In  this 
and  the  following  figures,  the  black  rectangles  are  used  to  denote  the  busy  time  of  the  coordinator, 
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and  the  shaded  rectangles  the  busy  time  of  the  planners.  The  white  areas  denote  idle  time. 


Coordinator 

Planner  1 
Planner  2 
Planner  3 


—  - -  ►  ELaspedTime 

Figure  2.  Basic  Information  Scheme  (BIS) 

3.2  Early  Start  Information  Scheme  (ESIS) 

In  BIS,  the  coordinator  is  totally  unproductive  when  the  planners  are  working.  Actually  he 
can  begin  processing  some  of  the  proposals  as  soon  as  they  have  been  submitted.  Note  that 
eventually,  he  will  have  exactly  the  same  proposals  for  a  particular  cycle  as  in  BIS.  The  only 
difference  is  that  the  coordinator  starts  his  price  setting  problem  earlier.  We  call  this  the  early  start 
information  scheme  (ESIS). 

The  early  processing  of  proposals  to  determine  new  prices  does  not  guarantee  solving  the 
Master  Problem  faster.  It  may  even  require  more  time  than  starting  the  process  after  all  the 
proposals  are  received.  However,  it  is  hoped  that  the  overall  cycle  time  would  be  shorter  due  to 
increased  concurrency  among  the  coordinator  and  planners.  Note  that  the  proposals  and  prices 
generated  in  ESIS  are  identical  to  those  in  BIS.  Therefore,  any  effect  that  ESIS  may  have  on  the 
elapsed  time  of  the  planning  process  is  not  due  to  the  information  but  the  early  processing  of  the 
proposals.  An  intuitively  typical  case  of  ESIS  is  illustrated  in  Figure  3.  Comparing  Figures  2  and 
3,  we  see  that  although  the  time  required  to  generate  7t2  in  ESIS  is  longer  than  that  in  BIS,  the 
overall  time  for  cycle  1  is  shorter.  It  is  of  course  conceivable  that  the  early  start  somehow  leads  to  a 
much  longer  solution  path  to  n2  so  that  the  cycle  time  turns  out  to  be  longer  than  that  in  BIS. 
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Coordinator 
Planner  1 
Planner 2 
Planner  3 


ElaspedTime 


Figure  3.  Early  Start  Information  Scheme  (ESIS) 


3.3  Early  Termination  Information  Scheme  ( ETIS ) 

Given  a  set  of  prices,  each  planner  may  take  a  different  amount  of  time  to  generate  all  his 
proposals.  In  BIS,  the  planners  who  finish  early  will  have  to  wait  for  other  planners  who  are  still 
working.  In  the  early  termination  information  scheme  (ETIS),  the  coordinator  orders  all  the 
planners  to  stop  submitting  proposals  at  some  time  tx  to  reduce  waiting  times.  The  coordinator  will 
then  use  the  proposals  that  are  generated  prior  to  tx  to  determine  a  set  of  new  prices.  The  time  tx  can 
be  determined  in  several  ways. 

i)  First  Subproblem 

Let  tx  be  the  first  time  when  a  subproblem  is  completed.  If  there  is  at  least  one  proposal 
among  all  the  planners,  they  are  asked  to  stop  at  tx.  Otherwise,  they  are  allowed  to  continue  until 
the  first  proposal  is  submitted. 

ii)  First  Proposal 

The  planners'  cycle  is  terminated  as  soon  as  the  first  proposal  is  submitted. 

Hi)  Ad  hoc 

In  principle,  the  coordinator  can  decide  on  when  he  should  stop  the  planners  depending  on 
their  proposals  generation  patterns.  For  example,  he  might  observe  a  very  uneven  proposals 
generation  pattern  among  the  planners  where  one  or  two  of  them  generate  a  large  number  of 
proposals  while  the  rest  generate  very  few  and  stop  very  early.  In  such  a  situation,  he  might  allow 
fewer  number  of  proposals  to  be  generated  by  each  planner.  Similarly,  he  might  increase  the 
number  of  proposals  allowed  in  later  cycles  when  the  proposals  generation  pattern  changes. 
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ETIS  is  illustrated  in  Figure  4  .  Note  that  although  ETIS  is  depicted  to  have  a  shorter  cycle  1 
than  BIS,  the  7t2  generated  may  be  different.  Intuitively,  we  expect  ETIS  to  require  more  cycles 
than  BIS  since  fewer  proposals  arc  submitted  during  each  cycle.  The  advantage  of  ETIS  is  that  all 
planners  work  an  equal  amount  of  time. 


Coordinator 
Planner  1 
Planner  2 
Planner  3 


— . —  . -  — »•  Elapsed  Time 

Figure  4.  Early  Termination  Information  Scheme  (ETIS) 

3.4  Intermediate  Prices  Information  Scheme  (IPIS) 

The  prices  on  the  shared  resources  change  as  new  propopsals  are  processed  by  the 
coordinator.  In  all  the  information  schemes  described  so  far,  this  new  information  is  not  made 
available  to  the  planners.  Since  the  prices  information  is  critical  to  the  planners  in  deciding  on 
which  proposals  to  submit,  any  changes  in  prices  should  in  principle  be  fed  back  immediately  to  the 
planners.  Given  a  quicker  feedback  of  price  information,  the  planners  should  be  able  to  make  better 
decision  on  the  consumption  of  the  shared  resources  and  submit  proposals  that  would  enable  the 
planning  process  to  converge  faster.  The  question  is  which  prices  should  be  made  available  to  the 
planners  and  when  the  planners  should  make  use  of  these  new  prices. 

Prices  that  are  made  available  to  the  planners  while  they  are  still  in  the  process  of  generating 
proposals  are  referred  to  as  intermediate  prices ,  and  the  information  scheme  that  uses  them  is 
known  as  the  Intermediate  Prices  Information  Scheme  (IPIS).  Intermediate  prices  determined  by 
the  coordinator  can  be  fed  back  to  the  planner  at  different  rate.  Several  variations  of  IPIS  with 
different  frequency  of  prices  feedback  are  described  below. 

i)  Instant  Feedback 

Any  change  in  prices  is  immediately  announced  to  the  planners  who  will  continue  to  generate 
proposals  using  the  updated  prices.  This  extreme  utilization  of  prices  information  is  called  an 
Instant  Feedback  Strategy.  Suppose  the  coordinator  uses  the  simplex  method  to  determine  the 
prices.  Then  he  will  send  out  the  new  prices  and  incorporate  new  proposals  into  the  master  problem 
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after  each  simplex  iteration.  This  information  scheme  is  the  closest  to  instant  availability  and 
utilization  of  information  in  a  planning  process.  However,  many  systems  constraints  such  as  the 
capacity  of  the  planners  and  the  coordinator  to  store  and  process  such  intensive  flow  of  information 
should  be  considered  in  the  realization  of  this  information  scheme. 

ii)  N-pronosals 

To  study  how  the  different  rates  of  prices  feedback  affect  the  behavior  of  the  planning 
process,  we  control  the  amount  of  intermediate  prices  sent  to  the  planners  according  to  the  number 
of  new  proposals  that  have  been  incorporated.  This  indirectly  controls  the  "closeness"  between  two 
consecutive  sets  of  prices.  In  an  N-proposals  IPIS,  the  coordinator  does  not  process  new  proposals 
while  he  is  computing  new  prices.  New  proposals  submitted  during  this  time  will  be  stored  in  a 
buffer.  Once  a  set  of  new  prices  is  determined  and  released  to  the  planners,  the  coordinator  will 
then  check  the  buffer  for  new  proposals  and  collect  up  to  N  new  proposals  to  determine  the  next  set 
of  prices.  If  there  are  less  than  N  new  proposals  in  the  buffer,  all  will  be  collected  and  processed. 

The  frequency  of  prices  sent  to  the  planners  can  be  regulated  by  varying  the  value  of  N. 
Increasing  N  tends  to  reduce  the  number  of  intermediate  prices  sent  to  the  planners.  For  N  =  1  we 
have  the  One-proposal  IPIS;  and  for  N  =  ®®,  we  have  the  All-proposals  IPIS. 

IPIS  is  illustrated  in  Figure  5.  Note  that  there  is  no  clear  cycles  in  this  information  scheme. 
In  the  figure,  all  the  planners  update  the  prices  at  time  to,  tt,...,t6.  A  planner  becomes  idle  if  all 
proposals  according  to  the  current  prices  have  been  submitted  and  no  new  prices  are  received  (e.g. 
planner  1  between  t3  and  t4). 


Coordinator 
Planner  1 
Planner  2 
Planner  3 


tO  tl  t2  t3  t4  t5  t6 


-►  Elapsed  Tune 


Figure  5.  Intermediate  Prices  Information  Scheme  (IPIS) 
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3.5  Classification  and  Comparison  of  Information  Schemes 

Each  of  the  four  schemes  described  above  can  accommodate  further  strategic  variations  such 
as  the  exact  quota  on  proposals  for  each  master  cycle.  Therefore,  one  can  begin  to  classify  a  whole 
spectrum  of  detailed  decision-making  policies  into  the  four  catagories:  BIS,  ESIS,  ETIS  and  IPIS. 
Before  examining  the  potential  effectiveness  of  the  different  schemes  as  distributed  decision 
processes,  we  can  introduce  two  attributes  which  provide  insight  into  their  behavior.  The  first  is 
concurrancy,  i.e.  the  extent  to  which  parallel  processing  is  possible  among  the  agents  in  the 
decision  system.  The  second  is  information  flow,  i.e.  the  amount  of  communication  required 
among  the  agents.  Intuitively,  increased  concurrency  should  improve  the  convergence  rate  whereas 
increased  information  flow  should  have  the  opposite  effect  The  four  catagories  of  information 
schemes  are  mapped  on  these  relative  scales  in  Figure  6. 

ESIS  can  be  made  to  follow  exactly  the  same  path  as  BIS.  Therefore,  the  information  flow  is 
the  same  for  the  two  schemes.  However,  ESIS  gains  concurrency  of  the  processes  by  letting  the 
master  (coordinator’s)  problem  become  active  as  soon  as  proposal  information  is  made  available. 
Therefore,  one  can  expect  ESIS  to  be  more  effective  than  BIS.  In  ETIS,  concurrency  among  the 
planners  is  improved  by  reducing  the  time  spent  by  the  faster  ones  waiting  for  the  slower  ones. 
This  policy  may  degrade  the  quality  of  proposals  in  a  cycle.  The  overall  effectiveness  will  be  a 
trade-off  dependent  on  other  properties  of  the  decision  system.  Similarly,  variations  of  IPIS  tend 
towards  a  process  of  continuous  updating  of  information  keeping  all  the  agents  busy.  In  so  doing, 
the  volume  of  communication  is  bound  to  increase.  Whether  it  outweighs  the  benefits  of  keeping 
the  agents  better  informed  is  again  a  matter  of  trade-off.  We  will  show  by  numerical  examples  that 
e?ch  information  scheme  may  be  effective  for  some  decision  systems  but  not  for  others.  For  this 
reason,  rather  than  looking  for  a  universally  superior  scheme,  it  will  be  more  meaningful  to 
characterize  distributed  decision  systems  by  their  most  favorable  schemes. 
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Information 

Flow 


IPIS:  Instant  feedback 

One-proposal 

All-proposal 


ETIS 

BIS  ESIS 

- » 

Concurrency 

Figure  6.  A  Two- Attribute  Comparison  of  Information  Schemes 
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4.  Numerical  Examples 


In  this  section,  we  illustrate  the  various  information  schemes  in  distributed  DWDA  with 
numerical  examples.  The  examples  are  constructed  to  demonstrate  the  effect  of  different  proposals 
generation  patterns  on  the  behavior  of  the  algorithm.  The  following  linear  program  is  used 
throughout. 


min 

s.t. 


-2Zo  +2Zi 

-  Zi 

Zo 

-Xi 

-X2 

+  X2 

-Yi 

+Yi 

+Y2 

-Y2 

£  0 

£  0 

X2 

£5 

Xi 

+  2X2 

£  13 

4Xi 

+  3X2 

£32 

3Yi 

+  Y2 

£  6 

Yi 

+  Y2 

£4 

Yi 

+  2Y2 

S6 

Yi 

-2Y2 

£2 

Yi 

-  Y2 

£4 

2Yi 

-  Y2 

£11 

2Yi 

-3Y2 

£31 

Y2 

£7 

-Yi 

+  3Y2 

£18 

(SI) 


(S2) 


Zo,  Zi.Xi.X2,  Yi.Y2  £0 

The  feasible  regions,  sets  of  extreme  points,  and  the  corresponding  proposals  for  SI  and  S2 

are  given  in  Figure  7.  In  the  following  examples,  the  initial  price  vector  [jtj.Jt^Oj.Oj]  is  set  to  [  0 
0  0  0],  and  the  initial  set  of  proposals,  Q°,  consists  of  pi  and  q6. 
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We  have:  Cl 
Also, 

A  1 


=  [  0  -1  ] 


and  C  2 

.and  A2 


pi  s[ -5  10310] 
p2  =s  l  -5  I  -3  5  10] 
°rS1  :  p3  =  [-41-5 410] 
p4  =  [  0  1-8110] 
p5  =  [  0  10  010] 


and  for  S2 : 


=  [-11  1 


ql  ■  [  610-601] 
42*  [  211-301] 
q3*l  012-201] 
q4  *[-314-101] 
q5  » [  -4 1 6  -2  0  1  ] 
q6  *[-417-3  01] 
q7  *  [  -3 1 8  -5  0  1  ] 
q8»[  215-701] 
q9-[  413-701] 


Figure  7.  A  Numerical  Example 


For  ease  of  illustration,  we  assume  that  the  time  needed  to  solve  the  master  problem  is  given 
by  to  =  IYI  units,  where  Y  is  the  set  proposals  incorporated  into  the  master  problem,  and  IYI  is  the 
cardinality  of  Y.  Also,  for  simplicity,  we  assume  no  transmission  time  in  sending  messages.  In  all 
cases  considered,  a  maximum  of  two  proposals,  the  first  and  the  last  extreme  points  that  qualify  as 
proposals  will  be  submitted  by  a  subproblem  in  any  cycle.  For  example,  suppose  (4,1)  -  (6,2)  - 
(7.3)  -  (8.5)  -  (5.7)  is  the  simplex  path  of  extreme  points  followed  by  S2  with  prices  itk,  where 
the  extreme  points  that  qualify  as  proposals  are  underlined.  Then  only  the  proposals  corresponding 
to  (7,3)  and  (5,7)  are  generated. 

The  prices-proposals  coordination  process  is  shown  in  the  form  of  a  prices-proposals  graph 
(see  e.g.  the  top  part  of  Figure  8).  A  square  node  in  the  graph  represents  Jtk,  where  k  denotes  the 
order  in  which  the  prices  are  generated.  A  circular  node  denotes  a  proposal.  A  proposal  q  is 
generated  with  ttk  if  there  is  a  directed  arc  from  node  rtk  to  node  q.  The  price  vector  jtk  is 
generated  with  the  proposal  set  Q,  which  consists  of  all  the  q's  that  have  directed  paths  to  the  node 
7tk.  A  dashed  arc  from  a  node  Jt1  to  another  node  rti  indicates  that  all  proposals  used  in  generating 
Tt1  are  also  used  in  generating  7tJ. 

To  show  the  effect  of  different  proposals  generation  patterns  we  use  hypothetical  solution 
times  for  the  subproblems.  This  is  simply  equivalent  to  assuming  various  response  times  for  the 
planners  so  that  the  results  should  represent  plausible  rather  than  overly  contrived  scenarios. 

4. 1  Examples  of  BIS  and  ESIS 

Figure  8  shows  the  sequence  of  prices  generated  using  BIS  and  ESIS.  In  this  and 
subsequent  diagrams,  a  black  dot  on  the  time  line  denotes  the  point  in  time  when  a  proposal  is 
generated.  The  shaded  rectangles  denote  the  busy  periods  when  the  coordinator  is  solving  the 
master  problems.  With  the  hypothetical  solution  times  given  in  Figure  8,  the  elapsed  times  for  BIS 
and  ESIS  are  10  units  and  7  units,  respectively.  Note  that  the  elapsed  time  for  BIS  depends  only  on 
when  the  last  proposal  is  generated  in  each  cycle. 

4.2  Examples  of  ETIS 

The  prices-proposals  graph  using  ETIS  (First- subproblem)  is  shown  in  Figure  9.  Comparing 
to  the  case  of  BIS,  the  omission  of  proposal  p4  in  cycle  1  due  to  early  termination  results  in  the 
price  vector  (-0.875,  -2,  2.375,  -6)  in  cycle  2.  This  causes  the  proposals  p3,q8,q9  to  be  generated. 
These  proposals  are  not  generated  in  BIS  and  ESIS.  In  this  example,  p4  is  a  "critical  "  proposal  in 
the  sense  that  any  basis  without  p4  will  not  be  optimal.  The  omission  of  p4  leads  to  a  longer 
sequence  of  prices  and  extraneous  proposals.  The  reduction  in  waiting  times  (waiting  for  p4in 
cycles  1  and  2)  is  outweighed  by  the  additional  computational  efforts  required  by  a  longer  sequence 
of  prices. 
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Figure  10  shows  the  behavior  of  ETIS  using  a  different  hypothetical  proposals  generation 
pattern.  In  this  case,  qi  is  omitted  due  to  early  termination.  However,  it  does  not  cause  a  longer 
sequence  of  prices  and  actually  provides  an  improvement  in  the  elapsed  time.  Note  that  this  gain 
comes  from  both  the  reduction  of  waiting  times  and  a  smaller  master  problem.  The  two  examples  of 
ETIS  show  that  the  relative  response  times  of  the  planners  are  crucial  factors  in  its  effectiveness.  If 
SI  finishes  first,  we  have  the  second  example  and  ETIS  works  well. 
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S2 
SI 

Master 
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Elapsed  Time 


q7  ql 
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Figure  8.  Examples  of  BIS  and  ESIS 
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Figure  9.  First  Example  of  ETIS 
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4.3  Examples  ofIPIS 

A  proposals  generation  pattern  and  the  resulting  prices-proposals  graph  using  IPIS 
(All-proposals)  are  shown  in  Figure  11.  With  this  information  scheme,  the  coordinator  starts 
working  as  soon  as  q7  is  received.  Two  more  proposals,  generated  with  it1  arrive  while  the 
coordinator  is  working.  At  the  time  7t2  is  available  to  the  subproblems,  SI  is  still  busy  while  S2  is 
not.  The  arrival  of  prices  n2  starts  S2,  which  generates  qi  at  optimality.  Note  that  qi  has  already 
been  generated  with  Jt1.  We  call  qi  a  repeated  proposal.  As  soon  as  SI  receives  it2  it  stops  using 
Tt1  which  so  far  has  generated  pi.  At  optimality  of  SI  under  n2,  p4is  obtained.  Similarly,  n3 
causes  q9  of  S2  and  p4  of  SI  to  be  generated.  Note  that  p4is  again  a  repeated  proposal.  The 
elapsed  time  for  this  example  is  approximately  8  units. 

The  behavior  of  IPIS  assuming  a  different  proposals  generation  pattern  is  shown  in  Figure 
12.  Note  that  repeated  proposals  are  again  involved.  These  examples  demonstrate  that  the  more 
frequent  communication  of  prices  may  not  necessarily  speed  up  the  distributed  decision  process. 
The  intermediate  prices  definitely  increase  the  volume  of  information  transmitted  among  the  agents. 
Portions  of  the  additional  information  may  be  extraneous,  e.g.  in  the  form  of  repeated  proposals. 
Whether  the  benefits  of  intermediate  prices  outweigh  their  cost  again  depends  on  the  relative 
response  times  of  the  agents. 
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Figure  1 1.  First  Example  of  IPIS 
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5.  Conclusions 


For  distributed  decision  processes  that  can  be  modeled  as  the  decomposition  of  linear 
programs,  we  have  shown  that  the  dynamics  of  information  among  the  agents  play  a  crucial  role  in 
the  effectiveness  of  particular  strategies  or  policies.  Four  classes  of  decision  policies  are  discussed 
formally  as  information  schemes.  In  the  basic  scheme,  the  coordinator  sets  prices  and  then  the 
planners  submit  proposals  accordingly.  When  all  the  proposals  are  in,  the  coordinator  gets  to  work 
again  to  determine  the  next  round  of  prices.  The  relative  timing  of  the  proposals,  which  reflects 
perhaps  individual  work  style  or  other  behavioral  aspects  of  the  planners,  does  not  matter  in  this 
case.  The  early-start  scheme  has  the  coordinator  going  back  to  work  as  soon  as  proposals  become 
available.  Meanwhile,  the  planners  continue  to  submit  proposals  based  on  the  last  set  of  prices.  The 
same  sequence  of  prices  as  in  the  basic  scheme  is  obtained.  Potential  advantage  comes  from  the  fact 
that  the  coordinator  is  getting  a  head  start.  Of  course,  it  is  also  possible  that  the  partial  information 
used  in  such  an  early  start  may  mislead  the  coordinator,  in  which  case  he  might  be  better  off 
waiting  for  the  entire  batch  of  proposals.  As  to  the  planners,  uneven  response  times  mean  that  some 
of  them  waste  a  lot  of  time  waiting  for  others  to  finish  their  round  of  proposals.  The  early- 
termination  scheme  has  all  of  them  stopping  at  some  threshold  time,  e.g.  when  the  first  planner 
finishes.  They  then  wait  for  the  coordinator  to  set  new  prices.  How  well  this  works  compared  to 
the  basic  scheme  depends  largely  on  the  information  omitted  due  to  the  early  termination.  Examples 
are  shown  for  both  cases.  How  about  more  information  and  sooner?  This  can  be  accomplished  by 
extending  the  early-stan  scheme.  Working  with  proposals  as  they  arrive,  the  coordinator  can  revise 
the  prices  constantly.  Should  these  prices  replace  the  old  ones  at  once?  Intuitively,  the  idea  of 
instant  feedback  of  information  and  a  decision  process  that  approaches  continuous  adjustment  has 
certain  appeal.  In  reality,  the  burden  of  such  excess  of  information  and  communication  may  be 
difficult  to  overcome.  Again,  examples  are  given  to  illustrate  this  point  concerning  such 
intermediate-prices  schemes.  Our  study  shows  that  it  is  not  meaningful  to  look  for  a  universally 
superior  information  scheme.  However,  using  our  approach  of  observing  behavioral  patterns  of  the 
coordinator  and  planners  to  the  study  of  the  dynamics  of  information  among  them,  it  may  be 
possible  to  identify  effective  schemes  for  specific  decision  systems  and  conversely,  to  classify 
distributed  decision  systems  by  their  most  favorable  schemes. 
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